Biases in Large Language Models: Origins, Inventory, and Discussion
نویسندگان
چکیده
In this article, we introduce and discuss the pervasive issue of bias in large language models that are currently at core mainstream approaches to Natural Language Processing (NLP). We first data selection bias, is, caused by choice texts make up a training corpus. Then, survey different types social evidenced text generated trained on such corpora, ranging from gender age, sexual orientation ethnicity, religion culture. conclude with directions focused measuring, reducing, tackling aforementioned bias.
منابع مشابه
Behavioral Finance Models and Behavioral Biases in Stock Price Forecasting
Stock market is affected by news and information. If the stock market is not efficient, the reaction of stock price to news and information will place the stock market in overreaction and under-reaction states. Many models have been already presented by using different tools and techniques to forecast the stock market behavior. In this study, the reaction of stock price in the stock market was ...
متن کاملLarge Margin Neural Language Models
Neural language models (NLMs) are generative, and they model the distribution of grammatical sentences. Trained on huge corpus, NLMs are pushing the limit of modeling accuracy. Besides, they have also been applied to supervised learning tasks that decode text, e.g., automatic speech recognition (ASR). By re-scoring the n-best list, NLM can select grammatically more correct candidate among the l...
متن کاملLarge Margin Neural Language Models
Neural language models (NLMs) are generative, and they model the distribution of grammatical sentences. Trained on huge corpus, NLMs are pushing the limit of modeling accuracy. Besides, they have also been applied to supervised learning tasks that decode text, e.g., automatic speech recognition (ASR). By re-scoring the n-best list, NLM can select grammatically more correct candidate among the l...
متن کاملMetasignaling and Language Origins
Over the past two decades, comparative linguistic anthropological research has disclosed the significance of metadiscourse and metasignaling for the establishment, maintenance, and transformation of social relations. One type of metasignal-signal relationship has, because of its role in producing sociability, come to seem especially interesting with regard to the evolutionary origins of human l...
متن کاملLearning biases and language evolution
Structural hallmarks of language can be explained in terms of adaptation, by language, to pressures arising during its cultural transmission. Here I present a model which explains the compositional structure of language as an adaptation in response to pressures arising from the poverty of the stimulus available to language learners and the biases of language learners themselves.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Data and Information Quality
سال: 2023
ISSN: ['1936-1963', '1936-1955']
DOI: https://doi.org/10.1145/3597307